EL977165986US 

Fit :3036.VSD 

D Ck tN . AUS920030741US1 
Dmitr vichetal. 

System and Meth d f r Embedded Java Mem ry F tprint Perf rmance Impr vem nt 

1/10 



Virtual Machine Paging 
100 



Receive Virtual Machine 
Method Request 
110 



1 



Decide Whether to Compile 
(e.g., JIT) the Method 
120 



Yes 



Process Paging for 
Compiled Code 
(See Figures 5-9) 
140 • 




145 



No 



Process Paging for 
Interpreted Code 
(See Figures 3-4) 
150 




Figure 1 



Fil :3036.VSD 

D cketN . AUS920030741US1 
Dmitrovich et al. 

System and Meth d f r Embedded Java Mem ry F tprint P rf rmanc Impr vem nt 

2/10 



Special JIT Filesystem 
(JITFSD) 

220 





JIT Cache 






225 









Real Filesystem 

235 




Java Virtual 
Machine 
(JVM) 
280 



Memory Map 
200 




Kernel 

202 



Filename of Program 
204 



Environment 
2Q6 



Arguments 
208 



Data Binding Info. 
21Q 



Stack 
212 



Memory Mapped 
JIT Pages 

230 



Memory Mapped 
JXE File 

250 



BSS 272 



Data 274 



Text 276 



Java Heap 
292 



BSS 294 



Data 296 
Text 298 



Figure 2 



File: 3036.VSD 

D cketN . AU5MPP3P741MS1 
Dmitrovich etal. 

System and Meth d f r Embedded Java Mem ry F tprint P rf rmance Improvem nt 

3/10 



Read-Only Section 
(e.g., bytecodes) 
310 



Read-Write Section 
(e.g., variables) 
32Q 



Executable Image 

(e.g., JXE file) 
_ 300 



Memory Map 

Map Entire RIO 
(Code) Section of 

File to Memory 
Using RIO Mapping 
330 



Memory Needed 

O/S Selects and Discards 
Previously Loaded Pages. 

Allows System Paging to 
be Applied to Java 
Bytecodes 

370 



-mmap- 



-r — Read Pages (as needed)- 



<•) 



Device Memory (RAM) 

(See Figure 2 
for Memory Map Details) 
350 



Page Reads 

Startup, e.g., call of main(), 
or Call of Any Unloaded 
Code Causes Page Fault 

O/S Page Fault Handler 
Reads in Needed Page 
Due to Memory Mapping 

360 



Figure 3 



Pil :3036.VSD 

D ck tN . AUS920030741US1 
Dmitr vich tal. 

System and Meth d f r Embedded Java Mem ry F tprint P if nuance Improvem nt 

4/10 



Virtual Machine (JVM) 
Program Loader 
400 



Operating System (O/S) and Filesystem Components 



Receive Program Request 
(Program Stored in 
Nonvolatile Storage) 
410 



I 



Allocate Address Space 

for Program 
(Physical Memory Can Be 
Smaller than Program Size) 
420 



Filesystem mmap 

Setup Mappings 
430 



OS Page Map pings 

Nonvolatile Location 
Page Address 

435 



Map (mmap) Program from 
Nonvolatile Storage Location to 
Allocated Memory Location 
425 



Load R/W Section of Program 
(e.g., variables, etc.) 
440 



I 




Initialize Program 
(e.g., Branch to Beginning 
Causes Page Fault) 
460 



Execute Code 
(Needed Pages Automatically 
Loaded by OS When Page 
Faults Occur) 
4Z5 



i 



O/S Page Fault Handler 

Load Page(s) 
470 



JXE Pages 

(See Figure 2 
for Memory Map Details) 
480 



End 
495 



Figure 4 



O/S Paging Process 

• O/S Selects and 
Discards Previously 
Loaded Pages 

• No Need to Write Pages 
to Nonvolatile Storage 
as Pages Already 
Mapped R/O to 
Nonvolatile File 

49Q 



File: 3036. VSD 

D cketN . AUS920030741US1 
Dmitrovich t al. 

System and Meth d f r Embedded Java Mem ry F tprint P rf rmance Improvement 

5/10 




Initialize Virtual Machine 

(e.g.,JVM) 
510 



Filesystem 
(JITFSD) 

540 



mman- — 

--Mapping Data- 



Mapping of 
Files & Pages 
560 



Execute Programs Using Virtual Machine 

520 



JIT Compiler 

(See Figure 6) 
530 



Exception Handler 

• Retrieves Code Based 
Upon Faulting Page 
Address After Page 
Discarded by O/S 
5J0 



Re-JIT 



JITed Code 

(Discardable 
by O/S) 
550 




File: 3036.VSD 

Docket N . AUS920030741US1 
Omitrovich et al. 

System and Meth d f r Emb dded Java Mem ry Fo tprint P rf rmance Improvement 

6/10 




Initialize Mapping Data 
to Track Compiles 
610 

I 



Initialize New 
Filesystem (JITFSO) 

• Supports Memory 
Mapping (mmap) 

• When O/S Calls to 
Load Page: 

♦ fills page with 
zeros (0s) 

♦ returns OK 
When O/S Calls to 
Discard (Swap) 
Page: 

♦ returns OK 

♦ does not 
actually write 
page to 
nonvolatile 
storage 

620 
I 



Setup Error Handler 
for Invalid Opcode 
(opcode = "0") 
625 



I 



Create JIT Special File 
Using JITFSD 
630 



X 



mmap Special File 
(O/S Returns Address 
of Address Space) 
640 



Mapping Data 

- Method 
Name 

- Address 
Range 

615 

* 



1 



Check Mapping Data for 
Method being Compiled 
650 



Special File 
(JITFSD) 
635 



JIT Address 

Space 
(See Fig. 2) 
645 

r 




Retrieve Allocated 
Page Addresses 
655 



Compile Code to 
Allocated Pages 
660 



678 



^-No- 



Allocate Pages 
680 



I 



Compile Code to 
Allocated Pages 
685 
I 




Write Mapping 
Data 
690 

f Return > 
i 695 j 



672 - Yes 




♦ 






Increase JIT 








Address Space 








(See Figure 7) 








675 





Figure 6 



Fil :3036.VSD 

D cketN . AUS920030741US1 
Dmitr vichetal. 

System and Meth d f r Embedded Java Mem ry F otprint P rf rmanc Improv ment 

7/10 



Increase JIT Address Space 
ZOO 



JVM Usage 
Statistics 
720 



Retrieve Usage Statistics 
for Compiled (JITed) Code 
Z10 



Mapping Data 

- Method 
Name 

- Address 
Range 

740 




Reclaim Address Space by Removing Entry 
for Each Identified Seldom Used Method 
730 



-Yes- 





752 



Create Another JIT Special 
File Using JITFSD 

760 



mmap Special File 
(O/S Returns Address of 
Another Address Space) 
770 



Map for New 
Address 
Space 
785 

/ Return 
V 795 



Initialize Mapping Data to 
Track Compiles into Newly 
Created Address Space 
780 



Figure 7 



Fil :3036.VSD 

D Cket N . AUS920030741US1 
Dmitrovich t al. 

System and Meth d f r Embedded Java Mem ry F otprint P if rmance Improvement 

8/10 



OS Memory Manager 
(Memory Reclamation) 

soa 



Filesystem (JITFSD) 
840 



Identify JIT Heap Page(s) 
to Discard (Reclaim) 



JIT 

Address Space 
82Q 



Instruct Filesystem to Write 
Pages to Disk 
830 



Receive Notification 
Do Nothing with 
Page(s) 

Do Not Swap to 
Disk, etc. 
850 



Receive Return Code 
880 



1 




Return "C 
(i.e., "Su 
Return 
8J 


>K" Reply 
ccessful" 
Code) 
50 



End 
870 



Discard JIT Heap Page(s) 
890 



End 

(Memory Reclamation) 
895 



Figure 8 



File: 3036. VSD 



D ck tN . AUS92003Q741US1 
Dmitr vichetal. 

System and Meth d f r Embedded Java Mem ry F tprint P rf rmance Impr vement 

9/10 




Error Handler 
(Invalid Opcode "0") 
960 



Receive Error and 
Page Address 
965 



Lookup Method Name 
in Mapping Table 
970 




Run Java Bytecode, 
Remove Mapping Data 
985 



COS Memory Manager^N 
(Page Fault Handler) ) 
9QQ J 



Re-JIT Code 
(See Figure 6) 
990 



End 
398 



I 



Restart Instruction 
that Caused 
Page Fault 
995 



Detect Page Fault 
(Code Branch to 
Non-Loaded Page) 
£05 

I 



Call Filesystem to 
Handle 
Page Fault 
915 



Receive "OK" 
Reply from 
Filesystem 
940 



Restart Instruction 
that Caused Page 

Fault 

945 



Receive Error: 
Invalid Opcode 
950 



I 



Call Registered 
Error Handler 
955 



End 
958 



/ Filesystem (JITFSD) 
^ 920 



Receive Read Request 
925 



I 



Fill Page(s) Requested 
to Load with Zeros (0s) 
930 



E 





Return "OK" Reply 




(i.e., "Successful" 




Return Code) 


J 


935 



I 



End 

936 



Figure 9 



File: 3036.VSD 

D Ck tN . AUS9200307A1US1 
Dmitrovichetal. 

System and Meth d f r Embedded Java Mem ry Fo tprint P rf rmanc Improvem nt 

10/10 



1022 



JTAG/I2C Busses 



JTAG/I2C Busses 



V 



Processor(s) 

1000 



c 



Host Bus 

rzz 



I 



1001 



1002 



Level Two Cache 
1004 



JTAG/I2C Busses 



3 



Main Memory 
1008 



JTAG/I2C 



C 



PCI Bus 



I 



Service Processor 
Interface & ISA Access 
Passthru 
1012 



< 



PCI Bus 



I 




LAN Card 
1030 



101 
4 



> 



Service 
Processor 
1016 




1062 



1070- 



1068- 



Figure 10 



